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Abstract 


Parapsychology,  of  which  extrasensory  perception  (ESP)  is  a  branch,  is  not 
transitory.  Since  reports  of  apparently  significant  ESP  performances  are  increas- 
>ng  in  number,  it  becomes  more  important  to  use  the  most  rigorous  of  cxncrimental 
techniques  in  testing  the  ESP  hypothesis. 

A  design  of  a  sdontificallj  rigorous  experiment  in  ESP  is  presented  as  an  ac¬ 
ceptable  model  for  work  in  this  field.  This  report  covers  the  design  of  an  objective 
test  of  three  modes  of  ESP.  pretest  considerations  and  planning,  final  testing  and 

r*  *•  ■'—*  «— 

VERITAC  Finally,  a  statistical  analysis  of  the  results  and  a  discussion  of  statisti¬ 
cal  considerations  are  presented . 
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Testing  for  Extrasensory  Perception  v^th  a  Machine 


1.  INTRODUCTION 

Extrasensory  perception  is  often  discussed  by  laymen  and  scientists  in  emotional 
terms  because  the  present  research  evidence  pertaining  to  the  existence,  or  non¬ 
existence,  of  psychical  phenomena  appears  to  be  inconclusive.  Consequently,  ESP 
is  a  highly  controversial  subject,  and  one  can  quickly  become  embroiled  in  vigorous 
and  fruitless  argument  with  believers  and  non-believers  alike,  unless  he  is  extremely 
care'ful  in  his  discussion  approach. 

Perhaps  ESP  is  more  controversial  than  it  warrants.  Certainly,  it  offers  no 
threat  of  any  kind,  and  a  definite  requirement  exists  for  testing  its  hypotheses.  If 
the  claims  made  for  ESP  are  valid,  a  dear  understanding  of  how  and  why  it  operates 
is  essential  because  it  would  be  a  process  of  inestimable  utility.  On  the  other  hand, 
if  ESP  claims  could  be  conclusively  disproven,  many  thousands  of  dollars  and  sci¬ 
entific  man-hours  could  be  saved. 

Both  the  proponents  and  opponents  of  the  ESP  hypotheses  maintain  that  they  hold 
valid  reasons  for  their  positions.  However,  to  give  credence  to  apparent  manifesta¬ 
tions  of  ESP  in  its  various  forms,  one  must  entertain  the  idea  of  some  unknown  force 
which  often  repels  the  physical  scientist. 

Many  studies  appear  in  the  literature  that  make  some  extraordinary  claims  for 
the  existence  of  certain  kinds  of  ESP  behaviors  in  certain  kinds  of  people,  and  re¬ 
ports  of  significant  performances  are  increasing.  For  various  reasons  many  well 
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Because  there  exist  so  many  conflicting  attitudes  relating  to  ESP  in  general, 
the  independent  and  emotionally  unbiased  investigator  is  forced  to- conclude  that  the 
ESP  controversy  has  resulted  in  a  stalemate  -  that  neither  side  has  conclusively 
proven  Its  case  to  dete- 

Parspsychology,  of  which  ESP  is  a  branch,  is  not  transitory.  The  subject  is 
attracting  the  attention  of  an  increasing  number  of  respected  scientists.  With  re¬ 
ports  of  significant  ESP  performances  growing  in  number,  it  is  apparent  that  the 
time  is  fast  approaching  when  objective  and  emotionally  unbiased  scientists,  using 
rigorous  experimental  techniques,  must  test  the  ESP  hypotheses  in  order  to  make 
clear  the  nature  of  these  phenomena  to  themselves,  and  to  the  public.  Moreover, 
until  a  sizable  segment  of  the  orthodox  scientific  community  displays  the  integrity 
and  courage  to  conduct  a  series  of  appropriate  experiments,  and  publishes  both  posi¬ 
tive  ar.d  negative  results  impartially,  the  ESP  controversy  will  never  be  resolved. 

With  this  conviction  in  mihd,  the  authors  converged  on  the  problem  of  experi¬ 
menting  in  ESP  in  order  to:  (1)  test  the'r  own  skills  in  experimental  design  by  ap¬ 
plying  them  to  tliis  little  known  area;  (2)  develop  the  knowledge  which  could  lead  to 
intelligent  evaluations  of  existing  studies  3nd  opinions  in  the  field;  (3)  have  first¬ 
hand  ESP  testing  expeticnce  with  subjects  in  a  controlled  environment;  (4)  gain  ex¬ 
perience  in  analyzing  ESP  type  responses  in  a  rigorous  statistical  fashion;  <51  evalu¬ 
ate  various  data  collection,  data  reduction,  ami  statistical-analysis  techniques  for 
application  to  ESP  data. 

This  paper  is  not  intended  to  give  aid  or  comfort  to  either  faction  in  the  ESP 
controversy,  but.  rather,  it  is  a  straightforward  report  of  an  ESP  experiment,  the 
design  of  which  is  offered  as  an  acceptable  model  for  work  In  the  field. 

2.  RESEARCH  TEAM 

The  research  team  consisted  of  a  psychologist,  an  electronics  engineer,  a 
physicist  with  a  background  in  statistics,  and  a  mathematician.  Each  of  these  dis¬ 
ciplines  were  represorted  in  the  establishment  of  a  rigorous  experiment  in  ESP  be¬ 
cause  possible  weaknesses  in  applications  of  each  field  had  been  identified  in  the 
survey  of  the  literature. 

It  was  obvious  that  the  psychological  aspects  of  ESP  testing  must  be  accounted 
for.  considered,  and  controlled  in  expert  fashion.  Thus,  the  psychologist  was  part 
of  the  team,  in  order  to  develop  ami  implement  the  instrumentation  required  for 
stimulus  control  ar.d  automatic  response  recording,  an  electronics  engineer  adept 
at  designing  such  systems  was  required.  The  statistical  background  and  competence 
of  the  physicist  was  necessary  because  his  knowledge  relates  to  experimental  design. 
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3.  FIRST  CONSIDERATIONS 

A  survey  of  the  literature  definitely  disclosed  that  both  the  proponents  and  op¬ 
ponents  of  ESP  had  strong  and  telling  arguments  to  support  their  views.  It  was  ob¬ 
vious  then  that  these  arguments  had  to  be  taken  into  consideration  when  the  experi¬ 
ment  was  designed. 

Opponents  of  ESP.  and  even  those  who  support  the  concept  in  varying  degrees, 
emphasize  that  a  repeatable  experiment  has  never  b  vu  designed  in  this  field.  This 
stand  is  justified  from  a  physical  sciences  standpoint  utere  repetition  of  experiments 
and  consistency  of  results  are  mandatory,  and  historically  have  been  achievable.  If 
one  can  accept  ESP'as  a  bonafide  phenomenon  of  nature,  there  should  be  no  sound 
scientific  reason  why  repeatability  could  not  be  obtained.  1:  might  be  difficult,  but 
not  impossible. 

Opponents  of  EfP  often  claim  that  ex»  -*3  are  act  conducted  in  a  sufficiently 

rigid  manner  so  that  all  factors  can  be  cont  ..id.  They  insist  that  tight  reins  must 
be  kepi  on  experimental  design,  the  manner  s  .  which  sumull  are  presented  to  the 
subject,  the  selection  and  control  of  subjects,  and  the  capturing  of  responses  which 
come  from  the  experiment. 

The  esdstence  of  certain  clues  in  the  experimental  environment,  whether  audio, 
visual,  or  other  are  frequently  seen  to  be  possible  in  —.any  of  the  experimental  de¬ 
signs  that  have  been  previously  established.  The  use  oC  human  data  recorders  is 
also  a  real  weakness  from  which  many  studies  suffer.  The  possibilities  of  biasing 
the  results,  either  for  or  against  the  hypotheses,  or  of  making  up  fictitious  results 
exist  because  of  inadequate  data  recording  controls  In  —any  of  the  previous  experi¬ 
ments, 

irons  the  very  outset  of  tins  project  tne  investigators  attempted  to  overcome 
these  and  many  other  deficiencies  observed  in  the  historical  approaches  to  ESP  re¬ 
search.  There  was  no  desire  on  the  part  of  the  investigators  to  evaluate  the  con¬ 
cept  of  ESP  itself,  it  was  recognized  that  a  single  experiment  could  not  possibly 
lead  to  any  conclusive  evidence  either  for.  or  against,  fie  existence  of  ESP  phenomena 
Consequently,  the  main' effort  was  focused  upon  the  design  of  an  experiment  which 
could  be  repeated  by  other  researchers. 
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4.  APPARATUS 

The  VERITAC  is  an  vlccimme  and  electro- mechanical  system  specifically 
designed  to  be  used  in  conducting  ESP  experiments,  and  consists  of: 

1.  The  Control  Section  comprising: 

A.  Control  Console  {Figure  1} 

It.  Program  Cabinet  (Figure  2) 

C.  Data  Recording  Equipment  {Teletype* rite-  and  Tape  Reperforator. 

Figure  2) 

D.  Reaction  Time  Reeoriter  (Estorline  Angus  Recorder.  Figure  25 

2.  The  Subject's  Console  (Figure  3) 

When  the  svst.  ».  lus  been  set  up  for  making  tests,  ail  components  of  the  Con¬ 
trol  Section  are  installed  in  one  room  while  the  Subject's  Console  is  located  in  an¬ 
other  room,  an  appreciable  distance  front  the  first.  The  two  rooms  are  situated 
in  such  a  way  that  the  subject,  while  at  his  console,  is  unable  to  obtain  any  clues 
as  to  what  is  occurring  or  has  occurred  in  the  control  room. 

The  key  element  of  the  VERITAC  is  a  start -stop,  tsssh  button  operated  Random 
Number  Generator  Numbers  0  through  9  arc  generated  at  a  rate  of  approximately 
2500  per  sec.  and  when  the  generator  is  stopped,  the  last  number  generated  is  dis¬ 
played  by  a  neon  indicator  mounted  on  the  upper  right  front  panel  of  the  Control 
Console. 

The  VERITAC  is  used  to  measure  the  ability  of  a  subject  to  correctly  identify, 
in  the  absence  of  any  clues,  a  series  of  randomly  generated  numbers.  These  num¬ 
bers  are  presented  as  psi  stimuli  in  selected  modes  of  operation  and  the  subject 
interacts  with  the  VERITAC  in  prescribed  ways.  Responses  of  the  subject  are  auto¬ 
matically  titned.  compared  with  the  stimuli,  scored,  and  recorded. 


A  subject  is  tested  in  the  following  three  modes: 

1.  Clairvoyance:  A  condition  requiring  the  subject  to  select  the  number  which 
he  believes  has  been  generated.  The  subject  starts  and  stops  the  Handom  Number 
Generator  at  his  own  discretion.  The  numbers,  so  generated,  are  presented  as 
targets  in  the  Centrol  Console,  but  are  not  shown  to  the  subject  or  to  anyone  else. 

-•  Precognition:  A  condition  requiring  the  subject  to  select  beforehand  a 
number  which  he  believes  will  be  generated.  The  subject  starts  anti  stops  the  Han¬ 
dout  Number  Generator  at  his  own  discretion.  The  numbers,  so  generated,  are 
presented  in  the  Control  Console,  but  are  not  shown  to  the  subject  or  to  anyone  else. 

3.  Gen  'u  Extrasensory  PorcetXion  (GESP):  A  condition  requiring  the  sub¬ 
ject,  acting  as  a  percipient,  to  select  the  number  which  he  believes  has  been  gener¬ 
ated.  The  numbers,  so  generated,  are  presented  as  targets  in  the  Control  Console, 
but  are  not  shown  to  the  subject.  However,  they  are  seen  by  one  person  who  acts 
as  a  telepathic  agent  or  sender.  In  this  mode  clairvoyance  or  telepathy,  or  both, 
may  be  operating. 

Because  of  the  high  degree  of  automuticity  provided  by  ilie  VKH1TAC,  a  com¬ 
plete  man-machine  condition  is  obtained  in  clairvoyance  and  precognition  tests. 

This  is  extremely  advantageous  since  it  effectively  removes  any  biasing  effects 
which  could  be  introduced  by  the  investigatru  or  human  data  recorder.  In  GESP 


teats  an  agent  introduced  into  the  experimental  environment,  but  his  Only  function: 
are  to  sbservo  ami  concentrate  upon  the  generated  targets  (numbers). 

Reference  is  made  to  the  Basic  Block  Diagram  of  the  VERITAC  system  (Figure 
!).  The  Control  Section  components  are  shown  above  the  dotted  line,  and  the  Sub¬ 
ject5;;  Console  is  shown  below,  Nate  that  the  Control  Console  consists  of  three 
uiuts:  Random  Number  Generator  Unit;  Selector  and  Comparator  Unit;  Data  Pro¬ 
cessing  Unit,  Note  in  addition,  that  the  remotely  located  Subject's  Console  is  con¬ 
nected  to  the  Control  Console  by  a  cable. 


PROS HAM 
UNIT 


DATA 

PROCESSING 

UNIT 


CONTROL  I CONSOLE 


SUIJECT'S 

CONSOLE 


Figure  i 


Recall  that  the  subject  attempts  to  select  the  number(s)  which  he  believes  has 
been,  or  will  be,  generated.  By  pushing  the  appropriate  buttons  on  the  lower  panel 
of  his  console  (Figure  5),  the  subject  sets  the  generated  number  and  his  selected 
number  into  the  machine.  The  generation  of  a  number  and  the  selection  of  a  number 
constitute  one  'trial  sequence'.  The  order  of  number  generation  and  selection  is 
determined  by  the  type  of  test  being  conducted,  A  switch  in  the  Control  Console 
pre-sets  the  VERITAC  circuitry  so  that  the  system  will  not  function  until  the  proper 
trial  sequence  order  has  been  completed. 

Immediately  after  a  trial  sequence  has  been  properly  completed,  the  VERITAC 
goes  into  a  'locked'  condition,  and  remains  locked  until  the  data  in  the  machine  have 
been  printed  out  by  the  teletypewriter.  While  the  VERITAC  is  in  the  locked  condition, 
the  subject  can  neither  generate  additional  numbers  nor  change  his  selection. 
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Figure  5 


Two  elect  ro  -  m  eo  ha  ni  c  a  1  counters  are  mounted  on  tile  front  panels  of  each  con¬ 
sole  (Control  and  Subject's).  One  counter  is  labeled  ‘Trials'  and  the  other  is  labeled 
'Correct1.  These  v  nutters  provide  a  continuous  tabulation  of  the  number  of  trials 
and  the  number  of  correct  selections  mad-  by  the  subject  during  a  test.  If  it  is 
desired  to  withhold  this  information  from  the  subject,  the  counters  in  his  console  can 
be  disconnected. 

Mounted  in  the  Program  Cabinet  is  a  digital  clock  which  has  been  modified  for 
the  VKRITAC  system.  The  time  indicated  by  the  clock  is  recorded  on  the  data 
record  sheet  for  each  trial  sequence.  An  example  of  an  actual  data  record  sheet 
is  shown  in  Figure  <3. 

The  Reaction  Time  Recorder  is  an  listerline  Angus  single-pen  recorder.  By 
positioning  the  pen,  the  reference  line  is  made  to  fall  in  the  center  of  the  chart. 
Directional  changes  in  the  current  flow  through  the  instrument  will  cause  the  pen 
to  deflect  to  the  right  or  left  of  the  center  line. 

When  connected  to  the  V  KBIT  AC,  the  pen  is  deflected  to  the  right  when  the 
Random  Number  Generator  is  turned  on.  and  when  the  generator  is  turned  off.  the 
pen  drops  back  toward  the  center  line.  When  a  number  is  selected,  the  pen  deficit? 
to  the  left  and  then  returns  toward  tile  center  line. 
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The  recorder  chart  moves  at  the  rate  of  <5  inches  per  miiaite.  or  0.  1  inch  per 
second.  The  elapsed  time  between  number  generation  and  selection  is  measured 
from  the  time  the  needle  starts  to  drop  toward  the  center  line  Rafter  the  number 
has  been  generated)  until  it  crosses  the  center  line  as  the  number  is  selected.  A 
sample  of  an  actual  reaction  time  recording  is  shown  in  Figure  T,  Measurement 
accuracy  is  exact  to  1/2  sec  and  can  be  estimated  to  1/4  second. 

5.  EXPERIMENTAL  DESIGN 

As  soon  as  the  VER1TAC  became  available,  it  was  checked  for  operational 
effectiveness  and  accuracy,  and  several  pilot  studies  were  run.  These  studies 
showed  that  the  apparatus  would  perform  as  intended,  that  it  was  reliable  ir.  opera¬ 
tion,  and  that  the  generated  numbers  met  rigorous  statistical  criteria  for  random¬ 
ness. 

The  experiment  was  then  designed  with  the  VERITAC  as  the  key  element.  How¬ 
ever.  this  was  not  a  restriction  because  the  machine  had  been  designed  to  fulfill 
the  basic  requirements  set  forth  in  the  early  planning  phases  of  the  project. 

Three  types  of  psi  were  to  be  investigated:  Clairvoyance.  Precognition,  and 
General  Extrasensory  Perception  (GESP),  For  convenience,  lire  test  for  Clairvoy¬ 
ance  was  titled  Type  C;  for  Precognition,  Type  P;  and  for  GESP.  Type  G.  Each 
subject  was  to  complete  five  runs  of. each  type,  and  each  run  was  to  comprise  ion 
trials.  Therefore,  each  subject  was  to  make  500  psi  responses  -'n  order  to  complete 
a  test  series  of  one  type,  and  1500  psi  responses  to  complete  the  test  series  of  all 
three  types. 

In  1950,  Margaret  Knight  wrote:  "It  Is  a  waste  of  time  to  conduct  further 
laborious  experiments  merely  to  demonstrate  the  occurrence  of  ESP.  Thi3  h3S  now 
been  established  beyond  reasonable  doubt.  The  aim  of  future  experiments  should 
be  to  elucidate  the  conditions  of  its  occurrence,  for  in  this  way  alone  can  we  hope 
to  explain  its  nature.  * 

We  agree  with  Knight  that  more  than  enough  has  been  published  which  purports 
to  present  evidence  for  ESP.  More  important  now  would  be  good  experimental 
evidence  to  explain  the  mechanism  which  makes  ESP  work.  However,  before  the 
triggering  mechanism  can  be  identified,  the  phenomena  must  be  observed. 

If  our  experiment  could  uncover  several  subjects  who  apparently  displayed 
ESP  capabilities,  their  personalities  might  be  similar.  Certain  personality  traits, 
or  profiles  of  traits,  might  be  good  clues  in  determining  to  a  first  approximation 
which  type  of  people  could  best  perform  in  an  ESP  situation.  For  the  identification 
of  personality  traits,  the  Minnesota  Multiphasic  Personality  inventory  was  admin¬ 
istered  to  all  subjects  during  the  experimental  period. 


e  consideration  in  psi  testing  is  the  eimrofinserX  In  which  the  tests  ars 
The  criteria  for  a  suitable  environment  .‘-ere  considered  to  he: 


.i  pleasant ,  warm,  and  comfortable  atmosphere  as  opposed  to  the  cold 
■riiity  of  a  laboratory. 

2.  It  had  to  be  a  relatively  secluded  building,  preferably  somewhat  remote 
an  other  physical  structures  am!  office  activitie.  ,  so  that  distracting  influences 
I  interruptions  could  be  minimized. 

3  Location  of  the  testing  rooms  so  that  no  interaction  between  the  subjects 
i  other  individuals  or  the  control  equipment  would  be  possible. 

The  criteria  for  the  subjects  comprising  the  experimental  sample  were  estab- 
aed  as  follows; 

1.  From  a  statistical  standpoint,  it  was  desirable  to  have  a  sample  of  at  least 
subjects.  People  who  claim  .a  be  gifted,  or  are  reputed  to  be  gifted,  with  psi 
iity  are  difficult  to  find.  Therefore,  It  became  apparent  that  a  sample  of  appro- 
ate  size  would  have  to  be  selected  from  a  population  which  by  most  criteria  would 
considered  '  normal* , 

2  Some  authorities  in  parapsychology  believe  that  the  ESP  process  is  often 
.ntuitive  one.  Additionally,  women  are  sometimes  believed  to  be  more  intuitive 
a  men.  Therefore,  it  was  felt  that  our  sample  responses  would  be  optimized  if 
t  women  were  tested. 

3.  It  v  ns  essential- that  the  subjects  be  open,  friendly,  cooperative  volunteers, 
h  subjects  initially  would  be  highly  motivated  to  make  the  experiment  a  success, 
their  high  degree  of  motivation  could  probably  be  sustained  without  too  much 
iculty.  Also  it  was  felt  this  typo  of  subject  would  be  most  apt  to  b-_  receptive  to 
ESP  hypotheses. 

PRETEST  PLANNING 


iecluded  building,  preferably  somewhat  remote 


With  the  criteria  for  the  testing  environment  and  the  experimental  sample  final- 
i.  it  was  concluded  that  a  group  oLcollege  or  junior  college  girls  would  be  the 
r-opriate  sample  Tor  experimentation.  Appropriateness  in  this  case  related  to 
lability  as  well  as  to  composition  of  the  sample,  and  the  fact  that  the  required 
Tag  environment  could  very  probably  be  found  on  the  school  campus. 

After  considerable  searching,  Endieott  Junior  College  in  Beverly,  Massachusetts 
.  identified  as  an  ideal  place  for  the  experimental  trials.  When  the  college  Di¬ 
als  were  approached  with  the  proposal  that  the  experiment  be  conducted  there, 

.  oval  and  full  cooperation  were  immediately  given. 

Four  classes  were  contacted  by  the  experimenters,  Djgle  and  Hill.  A  brief 
Janation  of  psi  phenomena,  the  reasons  for  the  experiment  and  a  short  deserip- 
'  of  the  equipment  were  given  to  the  girls  in  each  class.  Questions  were  invited 
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and  answered,  and  when  volunteers  were  requested, the  response  was  most  grati¬ 
fying. 

A  short  time  later  each  volunteer  was  asked  to  meet  with  Dagle.  A  depth  type 
interview  was  conducted  in  an  effort  to  identify  eight  person:!  characteristics  or 
attitudes  which  were  originally  hypothesized  to  relate  to  the  experiment.  Each 
person  being  interviewed  was  rated  on  a  10-point  scale  for: 

1.  Degree  of  understanding  regarding  the  nature  of  the  experiment 

2.  Degree  of  previous  experiences  thought  to  be  ESP  types  (number  and  mag¬ 
nitude) 

3.  Degree  of  religiousness 

■1.  Degree  of  talkativeness  in  the  interview  situation 

3.  Degree  of  relaxation  in  the  interview  situation 

6.  Degree  of  interest  and  enthusiasm  in  the  experiment 

7.  Degree  of  flexibility  and  open-mindedness  regarding  the  experiment 

8.  Degree  of  belief  in  the  ESP  hypotheses  (Sheep-Goat  classification). 

The  'Sheep-Goaf  evaluation  involved  an  estimation  by  the  interviewer  of  the 
degree  to  which  each  subject  believed  in  ESP,  and  had  an  aggregation  of  personal 
characteristics  which  appeared  to  be  either  conducive  or  noncondacive  to  effective 
performance  in  the  ESP  situation.  This  rating  stems  from  other  research  in  ESP 
(Schmeidler  and  McConnell,  1958).  In  the  10-point  rating  system,  those  rated  from 
1  to  5  were  termed  'Goats',  while  those  rated  from  6  to  10  were  termed  ‘Sheep'. 

The  eight  characteristics  or  attitudes  evaluated  in  the  interview  were  to  be 
correlated  with  any  differences  in  performance  that  were  significant  in  the  experi¬ 
ment  to  come.  The  interview  was  a  nondirective,  probing  kind  and  it  is  estimated 
that  highly  reliable  evaluations  of  the  sample  were  obtained.  A  tabulation  of  the 
gradings  is  presented  in  Table  1. 

7.  TESTING 

Actual  testing  began  on  22  January  1962,  and  was  continued  every  school  day 
until  31  May  1962.  Subjects  were  scheduled  for  tests  at  the  most  convenient  times 
and  as  class  schedules  would  permit.  Subjects  rarely  failed  to  keep  their  appoint- 
:.ents,  and  there  was  very  little-free  time  between  test  sessions.  All  tests  were 
conducted  by  Dagle  and  Hill. 

The  testing  room3  on  the  second  floor  of  a  small  cottage  were  ideal,  and  the 
VERITAC  was  installed  in  such  a  way  that  no  feedback  or  communication  with  the 
subject  was  possible  once  the  tesf  run  had  begun.  Figure  8  shows  the  building  in 
which  the  test3  were  ~un  and  Figure  9  illustrates  the  floor  plan  of  testing  rooms. 

While  the  test  was  in  progress,  the  doors  to  the  subject's  room  and  the  control 
room  were  tightly  closed.  During  Type  C  and  Type  P  tests,  both  experimenters 
remained  in  the  office.  Daring  Type  G  tests  one  experimenter  acted  as  the  agent 
at  the  Control  Console  (Figure  10).  while  the  other  remained  in  the  office. 


< 


Figure  10 


Initially,  45  subjects  were  enrolled  for  the  experiment.  From  this  number. 
37  subjects  completed  the  entire  series  of  tests.  The  attrition  rate  of  only  8  sub¬ 
jects  indicates  that  the  high  degree  of  motivation  was  sustained  throughout  ii:e  en¬ 
tire  testing  period.  Of  the  8  drop-outs,  4  were  due  to  illness,  2  to  academic  dif- 
ficuiticd,  and  2  to  loss  of  interest. 


3.  RESULTS 

Each  subject  retained  in  the  final  sample  completed  5  runs  of  100  trials  each 
in  each  experimental  mode.  This  resulted  in  a  total  of  1. 500  psi  phenomena  re¬ 
sponses  for  each  subject,  or  55,  500  psi  phenomena  responses  for  the  total  group. 
Scores  for  each  subject  and  for  the  group  were  analyzed  by  appropriately  rigorous 
statistical  methods.  Tabulations  of  the  scores  are  contained  in.  Table  2. 

it  is  conventional  to  calculate  the  statistical  probabilities  of  chance  factors 
alone  being  responsible  for  the  scores  obtained  in  ESP  experiments.  Parapsycholo¬ 
gists.  m  general,  have  estabfished  a  probability  level  of  0.  01  as  the  criterion  of 
SliSEfigance.  and  in  our  evaluations  we  have  held  to  this  convention. 

A  summary  o:  our  evaluations  is  presented  herewith: 


i. 


For  the  Overall  Experiment 


Hits.  For  the  1.  500  responses  of  a  single  subject  in  the  entire  experiment, 
the  expected  hit  scote  is  150  since  for  each  trial,  there  is  1  chance  in  10  of  making 
a  hit.  The  binomial  probability  of  obtaining  172  or  more  lilts  is  less  than  0.  01. 

Two  subjects  (.Nos.  6  and  8)  obtained  scores  of  173,  a  deviation  of  +23  from  the 
expected  score.  It  is  interesting  to  note  that  one  subject  (N'o.  4)  obtained  a  score 
of  only  121.  a  deviation  of  -29  from  the  expected  score. 

Chi  Square  Test  of  Significance  for  the  Group.  A  Chi  Square  test  Of  signifi¬ 
cance  was  applied  to  the  total  scores  obtained  by  the  group.  A  Chi  Square  value 
with  37  degrees  of  freedom,  greater  than  73.  2  was  required  for  significance  (proba¬ 
bility  less  than  0.  01).  The  Chi  Square  value  obtained  in  this  test  was  33.  8296 
(p=0.  3751). 

Chi  Square  Test  of  Significance  for  Each  Subject.  Fifteen  runs  of  100  trials 
each  were  made  by  each  subject.  The  expected  score  for  each  run  was  10.  A  Chi 
Square  test  with  15  degrees  of  freedom  was  applied  to  each  subject's  scores.  For 
significance  a  Chi  Square  value  equal  to  or  greater  than  30.  578  was  required.  In 
no  case  was  this  value  obtained. 

Hit  Totals.  For  the  35,  500  responses  made  by  the  group  in  the  entire  ej  pe ri¬ 
med.  the  expected  number  of  hits  was  5,  500.  The  total  number  of  hits  obtained  by 
the  group  was  5,  567.  a  deviation  of  only  +67  from  the  expected  score. 

H.  For  Type  C  Tests 

Hits.  For  the  500  responses  of  a  single  subject  tn  Type  C  tests,  the  expected 
hit  score  was  50.  The  binomial  probability  of  obtaining  at  least  67  or  more  hits  is 
less  than  0.  01.  No  subject  obtained  a  hit  score  greater  than  64. 

Hit  Totals.  For  the  S3,  500  responses  of  the  entire  group  in  Type  C  tests,  the 
expected  hit  score  was  1.  850.  The  total  hit  score  obtained  was  1911,  a  deviation  of 
+51  from  the  expected  score. 

Chi  Square  Test  of  Significance  for  the  Group.  A  Chi  Square  test  of  significance 
with  37  degrees  of  freedom  was  applied  to  the  series  scores  obtained  by  the  group 
in  Type  C  tests.  A  Chi  Square  value  of  73.  2  was  required  for  significance  (p=0.01). 
The  Chi  Square  value  obtained  in  this  test  was  38.  733  (p=0.  39361. 

Chi  Square  Test  of  Significance  for  Each  Subject.  A  Chi  Square  test  of  signifi¬ 
cance  with  5  degrees  of  freedom  was  applied  to  the  run  scores  of  each  subject.  A 
Chi  Square  value  of  15.  086  was  required  for  significance.  In  no  case  was  a  value 
this  great  obtained  in  Type  C  tests. 

III.  For  Tyne  P  Tests 

Hits.  For  the  500  responses  of  a  single  subject  in  Type  P  tasts,  the  expected 
hit  score  is  50.  The  binomial  probability  of  obtaining  67  or  mere  hits  is  less  than 
0.  01  No  subject  obtained  i  hit  score  greater  than  64. 


Hit  Totals. 


esnecteu  tctru  hit  score  is 


iie  13,  aOO  responses  of  the  entire  group  in  i'ype  P  tests,  the 

r.Su  The  total  hit  score  obtained  •.  us  !  37 0,  a  deviation 


of  -  20  from  the  expected  score. 

Chi  Square  Test  of  significance  foi  the  Croup,  A  Chi  Square  test  of  signifi¬ 
cance  with  37  degrees  of  freedom  was  applied  to  the  series  scores  obtained  by  the 
group  in  the  Type  P  tests.  A  Chi  Square  value  equal  to  or  greater  than  73.  2  was 
required  for  significance  (p  1  0.  01).  The  Chi  Square  value  obtained  in  this  test 
was  31.  733  (p  =  0.  2820). 

Chi  Square  Test  of  Significance  for  ICach  Subject.  A  Chi  Square  test  of  signifi¬ 
cance  with  5  degrees  of  freedom  was  applied  to  the  run  scores  of  each  subject.  A 
Chi  Square  value  of  i5. 086  was  required  for  significance  (p-0.  0!).  One  subject 
(No.  6)  had  3  Chi  Square  value  of  17.  556  (p  1  0.  005). 

IV.  For  Type  G  Tests 

Hits.  For  the  500  responses  of  a  single  subject  in  Type  G  tests,  the  expected 
hit  score  is  50.  The  binomial  probability  of  obtaining  67  or  more  hits  is  less  than 
0.  01.  No  subject  obtained  a  hit  score  greater  than  54. 

Hit  Totals.  For  the  18,  500  responses  of  the  entire  group  in  Type  G  tests,  the 
expected  total  hit  score  was  1.850.  The  total  hit  score  was  1786,  a  deviation  of 
-64  from  the  expected  score. 

Chi  Square  Test  of  Significance  for  the  Group.  A  Chi  Square  test  of  significance 
with  37  degrees  of  freedom  was  applied  to  the  series  scores  obtained  by  the  group 
in  Type  G  tests.  A  Clii  Square  value  of  73.  2  was  required  for  significance  (p  2  6,01). 
The  Chi  Square  value  obtained  in  this  test  was  52.  622  (p  =  0.  0432). 

Chi  -S.Tuare  Test  of  Significance  for  Kach  Subject.  A  Chi  Square  test  of  signifi¬ 
cance  with  5  degrees  of  freedom  was  applied  to  the  run  scores  of  each  subject.  A 
Chi  Square  value  of  15.  035  was  required  for  significance  (p20.  01).  One  subject 
(No.  1)  obtained  a  Chi  Square  value  of  15.  333  (p  -  0.  01). 

V.  Chi  Square  Test  for  Goodness  of  Fit. 

The  individual  run  scores  for  each  type  of  test  were  grouped  in  classes  accord¬ 
ing  to  their  frequency  of  occurrence  (how  many  times  was  a  score  of  5.  S.  7,  8. . .  12 
and  so  forth  obtained),  and  a  Chi  Square  test  for  Goodness  of  Fit  was  applied  to  each 
type  of  test.  The  Chi  Square  values  and  probabilities  obtained  are  as  follows: 

Type  C:  Chi  Square  -  14.  000;  p  =  0.  2951 

Type  P:  Chi  Square  2  0.  9095;  p  2  0.  5394 

Type  G:  Chi  Squ-i'e  2  it.  124;  p  =  0.  2337 

A  probability  veiae  of  0. 01  was  required  for  significance. 

VI.  Analysis  According  to  Sheen-Goat  Classification. 

Referring  to  oar  Sheep-Goat  determination  obtained  from  the  depth  interviews 
of  the  volunteers,  -ve  found  that  our  sainnie  of  37  consisted  of  13  Sheen  and  19  Goats. 


lAtatfMNIltttMi*  «■  • 
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-»n  ana.>si3  ot  tr.e  results  obtained  by  each  group  resulted  in  the  following; 

SHEEP 
18  Subjects 

HiLlStals,  For  the  9000  responses  of  the  entire  group  in  each  tyne  of  test 

!“P  tCtal  SC°re  WaS  °°°-  The  total  Wt  •««  and  the  deviaion  front’ the 

expected  score  for  each  type  is: 

Type  C:  938:  Dev.  *38 
Type  P:  911:  Dev.  *11 
Type  G:  865;  Dev.  -35 

.,t,~rfgq,:are  ***********  the  Group  A  Chi  Square  test  of  significance 
"  13  °egree3  °f  freedom  *as  aPPU^  »o  the  series  scores  obtained  by  the  group 

Ip  '-ToITthTv  A  ^  SqUare  ValUC  °f  34-  805  '*aS  reqUired  for 

(p  -  0.  Ot).  The  following  were  obtained: 

Tf?e  C:  Chi  bcjuare  j  24.  344;  p  *  0  1355 

r  r v  I quare  =  ii-  133:  P  3  8865 

rjpeG.  Cht  Square  =  3a.  933;  p  =  0.  00365 

GOATS 
19  Subjects 

Mil  Totals.  For  the  9. 5G0  responses  of  the  entire  group  in  each  type  of  test 

•he  expected  total  hit  score  was  950.  The  total  hit  score  and  the  deviation  from  tee 
expected  score  for  each  type  is: 

Type  C:  973;  Dev.  +23 
Type  P:  959;  Dev.  *  q 
TypeG:  921;  Dev.  -29 

with^T^  Zlg,*nfMrr  f°r-  JiSJSjam-  A  Chi  Square  test  *  significance 
19  degrees  of  freedom  was  applied  to  the  series  scores  obtained  by  tee  -roup 

rrr  °htef„ A  chi  squarc  vaiue  °f  3s- 191  was  «*•*«■*  f°r  •****««. 

*?  ‘  0I»-  The  following  were  obtained: 

Type  C;  Chi  Square  =  13.  839;  p  >  o.  789-1 
Type  P:  Chi  Square  =  20.  600;  p  =  o.  3650 
Type  G:  Chi  Square  =  16,  689;  p  =  o.  6104 

9.  DISCUSSION 


The  original  intent  of  this  section  was  to  interpret  tec  statistics.  However 
since  no  extra-chance  effects  were  shown,  it  would  be  futile  to  do  so.  Nevertheless 
the  experiment  has  shown  that  certain  characteristics  of  probabilistic  research  may' 
.ead  to  inaccurate  interpretations  of  experiments  in  decision-making  guessing  ' 
communications,  and  ESP.  *' 

.  .  T!l'  "?St  ?°SS‘biiity  for  :r3erprctiva  errors  involves  the  use  of  the  word 
M6»licas*.  It  is  conventional  in  probabilistic  experiments  to  report  as  'significant' 


U:os> 


15; 


ng  which 


to  s  that  a  aor.*t:iaacc  agent  was  operative  i  ms  imerence  ss  unjustified,  :-*r  :■  ■; 
probabilistic  experiment  were  repeatei  1000  tin:eS.  10  of  the  resells  coals:  show 
'signifii  ant'  results  by  chance  alone.  To  carry  the  logic  or.e  step  further,  it  ap¬ 
pears  as  though  1/100  of  all  ESP  experiments  that  have  ever  been  conducted  have 
exhibited  'significance'.  However,  this  would  be  expected  according  to  probability- 
laws. 

.An  example  of  the  difficulty  of  interpreting  an  experiment  whose  sole  description 
is  in  terms  of  acceptance  or  rejection  of  the  null  hypothesis  may  be  sound  from  our 
own  data.  The  scores  of  the  most  promising  subjects.  Sheep,  were  separated  from 
the  scores  of  the  least  promising  subjects.  Coats,  fn  the  GKSP  test  for  Sheep,  a 
significant  group  %'  value  was  found  based  on  the  null  hypothesis;  the  probability 
of  the  hit  is  1/I0:h»  which  wculd  have  been  exceeded  by  chance  with  a  likelihood  of 
.  0069.  One  may  be  tempted  to  ccces*  this  as  a  truly  significant  result  because 
theoretically.  Sheep  are  supposed  to  score  more  non-chance  than  Gists,  and  here  a 
100  to  1  possibility  is  demonstrated.  We  can  cut  the  Odds  down  immediately  from 
100  to  I  to  15  to  1  by  observing  that  three  tests  were  applied  to  both  Sheep  and 
Goats  so  that  we  have  six  x~  values.  Furthermore,  when  the  non-ehanee  result 
is  attributed  to  the  fact  that  this  is  the  Sheep  group.  It  is  a  particularly  empty  form 
of  second  guessing  unless  one  predicted  this  would  happen  ansi  had  a  model  for  test¬ 
ing  this  hypothesis.  Two  pn nr: p:-*  emss.-s  emiid  have  made  our  ; -  . — hirii- 
Or.e  is  that  the  average  hit  probability  for  the  group  was  either  higher  or  lower  tlum 
1/10  tat  the  distribution  was  still  a  binomial  one.  The  ether  Is  that  some  people 
were  guessing  with  a  higher  probability  in  the  group,  while  ethers  with  a  lower 
probability,  the  mean  of  the  group  being  unchanged,  but  the  variance  of  the  distri¬ 
bution  being  thus  increased.  Prior  to  running  the  experiment,  we  had  no  means  of 
dividing  up  the  sheep  into  phis  and  minus  Sheep  you  might  call  them,  so  our  alternative 
hypothesis  was  that  the  mean  of  the  whole  group  would  be  shifted  either  up  or  down. 

‘i 

Calculation  of  the  x~  based  on  this  assumption  gives  a  new  significance  value  ef 
•  0074  as  opposed  to  .  0069  with  the  null  hypothesis.  The  implication  is  that  pre¬ 
suming  our  alternative  hypothesis  is  the  appropriate  one.  our  results  are,  never¬ 
theless,  due  to  chance. 


Another  logical  error  In  ESP  experiments,  in  particular 


: reduce*.!  by  the 


lack  of  rigor  in  setting  statistical  criteria  for  selecting  designs  for  repeatabill; 


m 
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role,  the  null  hypothesis  test  is  used  to  discriminate  between  two  classes  of  result; 
one.  the  majority,  which  is  clearly  chance;  and  the  other,  only  a  small  percentage, 
which  may  be  due  to  non-chance  factors.  This  process,  if  correctly  implemented, 
is  desirable  and  may  be  the  best  technique  for  ultimately  testing  ESP  phenomena. 

Even  if  it  is  assumed  that  ESP  is  a  real,  albeit  illusive  phenomenon,  this  method, 
to  be  effective,  must  be  used  with  a  full  knowledge  of  the  dramatic  effects  that  the 
statistical  criteria  impose  upon  the  selection  process.  For  this  method  to  be  effec¬ 
tive,  the  significance  level  must  be  carefully  chosen  in  relation  to  the  probability 
that  a  non-chance  phenomenon  may  operate  in  a  given  experiment. 

For  example,  suppose  that  ESP  operates  in  1/ 1000th  of  all  such  experiments. 
Then  of  those  experiments  which  show  'significant'  results  at  the  .  01  level,  9  out  of 
10  will  be  due  to  chance,  and  only  l  in  10  will  be  due  to  the  extra  chance  factor.  A 
model  designed  on  the  basis  of  the  ten  'significant'  experiments  will  be  weighted  90 
percent  on  the  basis  of  chance  results.  If  a  significance  level  of  ,  0001  is  demanded 
for  the  prototypes,  the  final  model  would  be  weighted  only  10  percent  on  the  basis 
of  chance  results  and  90  percent  on  the  basis  of  the  non-chance  findings.  The  percent¬ 
ages  would  be  reversed  by  changing  the  demanded  level  of  significance  from  .  01  to 
.  0001  if  the  assumption  were  made  that  1/1000  of  the  experiments  showed  true  results. 

At  first  the  manipulation  of  the  significance  level  may  appear  strange  and  some¬ 
how  wrong.  However,  if  a  non-chance  cause  is  operating  in  a  particular  experiment, 
there  is  no  reason  in  principle  why  we  cannot  demonstrate  it  at  any  significance  level 
no  matter  how  small.  In  fact,  the  ability  to  do  this  is  at  the  heart  of  the  probabilistic 
interpretation  of  the  experiment.  The  principal  effect  of  choosing  a  very  small 
significance  level  is  that  the  experiment  must  consist  of  a  great  many  trials  so  that 
the  result  will  be  suitably  discriminated  from  a  possible  chance  result.  If  a  signifi¬ 
cance  level  of,  for  instance,  one  millionth  is  used,  a  great  many  results  are  as¬ 
cribed  to  chance,  and  sufficient  trials  must  be  taken  to  insure  that  the  non-chance 
result  will  be  less  likely  still.  .Minor  Irritations  may  also  3rise  when  dealing  with 
small  significance  levels;  such  as.  the  inadequate  ranges  existing  in  prepared 
tables,  and  the  need  to  verify  that  approximate  distribution  functions  are  still  ap¬ 
plicable.  However,  these  are  details  which  have  nothing  to  do  with  the  principle  of 
the  matter. 

It  is  apparent,  therefore,  that  this  procedure  will  lead  to  very  long  test  runs. 
Parapsychologists  often  appear  to  avoid  long  test  runs  on  grounds  that  the  ESP  ability 
may  be  impaired.  This  may  or  may  not  be  true,  but  it  is  not  a  statistical  argument 
against  long  runs.  An  experimenter  may  develop  his  subjects  in  any  way  he  chooses 
and  when  he  considers  them  to  be  ready  may  start  his  trial  runs  for  record.  As  long 
as  the  run  length  (short  or  long)  and  the  number  of  runs  are  predetermined,  any  a- 
mount  of  meaningful  data  can  be  obtained  in  this  manner. 


In  summary,  it  seems  important  in  ESP  and  other  probabilistic  experiments 
to  insist  that  a  significance  level  be  selected  that  is  considerably  smaller  than  the 
frequency  of  the  hypothesized  occurrence  of  ESP  in  the  experiment.  Also,  long  trials 
and  many  experiments  are  required  in  order  to  satisfactorily  distinguish  ESP  from 
chance  when  it  does  occur,  and  many  experiments  are  required  to  get  a  significant 
sample  of  significant  experiments. 

By  implication,  it  becomes  important  to  make  public  ail  outcomes  of  experi¬ 
ments  whether  they  are  'significant'  or  'not  significant'  so  that  the  entire  sample  can 
be  viewed  in  truly  probabilistic  terms.  To  evaluate  a  phenomenon  by  considering 
only  the  significant  experiments  is  a  risky  method  in  probabilistic  experiments.  By 
following  these  recommendations  a  repeatable  experiment  in  ESP  may  be  developed 
and  the  extensive  correlates  which  are  eagerly  sought  should  be  stable  in  regard  to 
their  significant  ESP  behaviors. 


i 


. . . . . . . I . . . . iiiiiihihiiiiii . 


TARI.E  1.  Tabulation  of  depth  interview  scores 
ITEM" 
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j  No. 
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5 
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1.  Degree  of  understanding  regarding  nature  of  experiment. 

2.  Degree  of  ESP  experiences  (number  and  magnitude). 

3.  Degree  of  religiousness. 

4.  Degree  of  talkativeness  in  the  interview  situation. 

5.  Degree  of  relaxation  in  the  interview  situation. 

5.  Degree  of  interest  and  enthusiasm  in  the  experiment. 

7.  Degree  of  flexibility  and  open-mindedness  regarding  experiment. 

11.  Degree  of  belief  in  the  ESP  hypotheses  (Sheep-Goat  classification). 
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Glossary 


Parapsychology,  like  other  specialized  fields,  has  its  own  unique  vocabulary 
and  idioms.  For  those  unfamiliar  with  this  language,  the  following  glossary  has 
been  extracted  from  Parapsychology,  The  Frontier  Science  by  J.  B.  Rhine  and  J.  G. 
Pratt. 

Agent:  Sender  in  tests  for  telepathy,  the  person  whose  mental  states  are  to  be 
apprehended  by  the  percipient.  In  GESP  tests,  the  person  who  looks  at  the  stimulus 
object. 

Average  Score:  Average  number  of  hits  per  run. 

Call:  The  ESP  symbol  selected  by  the  subject  in  trying  to  identify  a  target. 

Chance  Expectation  =  Mean  Chance  Expectation:  The  most  likely  score  if  only 
chance  variation  is  present. 

Clairvoyance:  Extrasensory  perception  of  objective  events  as  distinguished 
from  telepathic  perception  of  the  mental  state  of  another  person. 

Deviation:  The  amount  an  observed  number  of  hits  or  an  average  score  varies 
from  the  mean  chance  expectation  or  chance  average.  A  deviation  may  be  a  total 
(for  a  series  of  runs)  or  average  (per  run). 

Displacement:  ESP  responses  to  targets  other  than  those  for  which  the  calls 
were  intended. 

ESP:  (Extrasensory  Perception):  Awareness  of  or  response  to  an  external 
event  or  influence  not  apprehended  by  sensory  means. 

Extrachar.re:  Not  due  to  charce  alone. 

GESP  (General  Extrasensory  Perception):  A  technique  designed  to  test  the 
occurrence  of  extrasensory  perception,  permitting  either  telepathy  or  clairvoyance 
or  both  to  operate. 
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P  (Probability):  A  mathematical  estimate  of  the  expected  relative  frequency  of 
a  given  event  if  chance  alone  were  operative. 

Parapsychology;  A  division  of  psychology1  dealing  with  behavioral  or  personal 
effects  that  are  demonstrably  nonphysical  (that  is.  which  do  not  fall  within  the  scope 
of  physical  principles). 

Percipient  =  Subject:  The  person  who  makes  the  calls  in  an  ESr  test. 

Precognition:  Cognition  of  a  future  event  which  could  not  be  known  through 
rational  inference. 

Psi:  A  general  term  to  identify  personal  factors  or  processes  which  arc  non¬ 
physical  in  nature.  It  approximates  the  popular  use  of  the  word  'psychic'  and  the 
technical  one  'parapsychic.il. ' 

Psi  Phenomena:  Occurrences  which  result  from  the  operation  of  psi  . . .  (for 
example,  ESP  phenomena). 

Run:  A  group  of  trials. 

Score:  The  number  of  hits  made  in  one  run. 

Total  Score:  Total  of  scores  made  in  a  given  number  of  runs. 

Series:  Several  runs  or  experimental  sessions  that  are  grouped  in  accordance 
with  a  stated  principle. 

Session:  A  unit  of  an  ESP  experiment  comprising  all  the  trials  of  one  test  oc¬ 
casion. 

Significance:  A  numerical  result  is  significaid  when  it  equals  or  surpasses  3ome 
criterion  of  degree  of  chance  improbability.  The  criterion  commonly  used  in  para¬ 
psychology  today  is  a  probability  value  of  .  01  or  less. 

Subject:  The  person  who  is  experimented  upon.  In  ESP  testa,  most  commonly 
the  percipient  (though  also  the  agent  in  GESP  and  telepathy). 

Target:  In  clairvoyance  or  precognition  tests  the  stimulus  object;  in  telepathy, 
the  mental  state  of  the  agent. 

Telepathy:  Extrasensory  perception  of  the  mental  activities  of  another  person. 

Trial:  In  ESP  tests,  a  single  attempt  to  identify  a  stimulus  object. 
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